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Abstract 

In the last decade, stochastic models have shown to be very useful for quantita- 
tive modelling of social processes. Here, a configurational master equation for the 
description of behavioral changes by pair interactions of individuals is developed. 
Three kinds of social pair interactions are distinguished: Avoidance processes, com- 
promising processes, and imitative processes. Computational results are presented 
for a special case of imitative processes: the competition of two equivalent strategies. 
They show a phase transition that describes the selforganization of a behavioral con- 
vention. This phase transition is further analyzed by examining the equations for 
the most probable behavioral distribution, which are BOLTZMANN-like equations. 
Special cases of BOLTZMANN-like equations do not obey the //-theorem and have 
oscillatory or even chaotic solutions. A suitable TAYLOR approximation leads to the 
socalled game dynamical equations (also known as selection-mutation equations in 
the theory of evolution). 

1 Introduction 

It is well-known that MARKOVian stochastic processes can be described by a master equa- 
tion. The master equation has found many applications in thermodynamics |IJ], chemical 
kinetics 0, laser theory || and biology [|J. Moreover, in the last decade Weidlich and 
Haag have successfully introduced it for the description of social processes ]5|, || like 
opinion formation [0], migration ||, agglomeration || and settlement processes [ [10[ . 



Since the master equation is difficult to solve (even numerically) one often examines 
the equations for the most probable distribution of states, instead. These equations are 
found to be "BoLTZMANN-/z£;e" equations, and have many applications to the kinetics 



of gases [11 1 or chemical reactions [12]. Special cases of BOLTZMANN-like equations have 



also become increasingly important in quantitative social science, namely the logistic 



equation for the description of limited growth processes |L3|, [14| and the socalled gravity 



modeHor intercity migration processes [15|. Recently, BOLTZMANN-like models have been 



suggested for avoidance processes of pedestrians |L6|, [L7j], and for attitude formation by 



direct pair interactions of individuals occuring in discussions [16, [18]. The models for 



attitude formation include cases of oscillatory or even chaotic behavior (see sect. |TT 
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Such behavior is, for example, known from fashion or economics (economic cycles, stock 
market). 

In the following, a master equation for behavioral changes by spontaneous transitions 
and pair interactions will be developed. It allows the description of the selforganization of 
behavioral conventions. Three kinds of social pair interactions are distinguished: Imitative 
processes, avoidance processes, and compromising processes. It turns out that for a special 
case of imitative processes the game dynamical equations result, which are used for the 
description of cooperation and competition processes. 

The game dynamical equations are empiricaly validated |19|, , and have many important 
applications in social sciences [21, 22] and economy [Q. They are also a powerful tool in 
evolutionary biology [[24], |25], |27|. Moreover, the Lotka-Volterra- equations p8| , p9fl 
for the description of predator-prey systems in ecology |30| are mathematically equivalent 
to a special class of game dynamical equations |3l| . 



2 The configurational master equation 

Suppose we have a system with a large number N ^> 1 of subsystems (e.g. a gas with N 
atoms). These subsystems are distributed over several states x (which e.g. distinguish the 
places r and velocities v of the atoms). If the occupation number n x means the number 
of subsystems that are in state x, we have the relation 

£n» = tf. (1) 

X 

The vector 

». (....//, )■•■■ (2) 

consisting of the occupation numbers is called the configuration of the system (since it 
contains all information about the distribution of the N subsystems over the states x). 
P(n, t) shall denote the probability to find the configuration n at time t. This implies 

0<P(n,t)<l and ^P(n,t) = l. (3) 

n 

The temporal development of the probability P(n, t) is governed by a master equation 
@: 

—P(nA) = inflow into n — outflow from n 

alt y ' 

= £w;(n|n / ;t)P(n / ,t) - ^w(n'|n;t)P(n,t) . (4) 

n' n' 

w(n'\n;t) are the configurational transition rates of transitions from configuration n to 
configuration n'. Often the dynamics of the system is mainly given by spontaneous transi- 
tions and direct pair interactions of subsystems. In this case, the configurational transition 
rates are of the following form [|32[ 



w(n'\n; t) :- 



w\(x'\x;t)n x if n' = n x i x 

w 2 (x', y'\x, y; t)n x n y if n! = n x > y > xy (5) 
otherwise. 
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• Spontaneous changes of the state from x to x' with an individual transition rate 
Wi(x'\x; t) correspond to transitions of the configuration from n to 

n x , x :=(..., (n x > + 1) . . . , (n x - 1), . . .) tr (6) 

with a configurational transition rate w(n x / x \n; t) = Wi(x'\x;t)n x , which is propor- 
tional to the number n x of subsystems that can change the state x. 

• Pair interactions leading one subsystem to change the state from x to x' and an- 
other subsystem to change the state from y to y' correspond to a transition of the 
configuration from n to 

n x > y > xy :=(..., {n x > + l),...,(n x -l),..., (ry + l),...,(n y - 1), . . .) tr (7) 

with a configurational transition rate w(n x i y i xy \n; t) = W2{x', y'\x, y; t)n x n y , which 
is proportional to the number n x n y of possible pair interactions between subsystems 
that are in state x resp. y (if n x ^> 1 where P(n,t) is not negligible, see [|32|j). 

The description of social processes often requires generalized configurational transition 
rates of the form 

Wi(x'\x; n; t)n x if n' = n x > x 

w(n'\n;t) := { w 2 (x',y'\x,y;n;t)n x n y if n' = n x , y , xy (8) 
otherwise, 

since individuals may react on the actual (socio) configuration n. The dependence of the 
individual transition rates W\ and W2 on n reflects indirect interactions of the individuals. 



3 Equations for behavioral changes 

For the description of a system of N individuals, the states x G {1, . . . , S} shall represent 
the possible behavioral strategies of individuals concerning a certain situation. The pair 
interactions 

x',y' < — x,y, (9) 

during which the strategies are changed from x and y to x' and y', can be completely 
classified according to the following scheme: 

(10) 
(11) 

- yj ) 

x,y' < — x, x iy' ^ x) 

x',y <— y,y {x' ^ y) } {11) (12) 

x',y' < — x, x (x' x, y' ^ x) 

x, y' < — x,y (1^ y, y' ^y,y' ^ x) 

x', y < — Xl y (x^y,x'^x,x'^y) } (III) (13) 

x',y' < — x,y (x ^ y, x' ^ x, y' ^ y, x' ^ y, y' ^ x) 
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y,x < — x,y (x^y) 

x',x < — x,y (i^!/,i'^3;,x'^i/) ^ (IV) (14) 
y,y' < — x,y (x ^ y,y' ^ y,y' ^ x) 

Obviously, the interpretation of the above kinds k G {0, 1, . . . , IV} of pair interactions is 
the following: 

(0) During interactions of kind (0) both individuals do not change their strategy. These 
interactions can be omitted in the following, since they have no contribution to the 
change of P{n, t). 

(1) The interactions (I) describe imitative processes (processes of persuasion), i.e., the 
tendency to take over the strategy of another individual. 

(II) The interactions (II) describe avoidance processes, where an individual changes the 
strategy when meeting another individual using the same strategy. (Processes of 
this kind are known as aversive behavior, defiant behavior or snob effect.) 

(III) The interactions (III) represent some kind of compromising processes, where an 
individual changes the strategy to a new one (the "compromise") when meeting an 
individual with another strategy. (Such processes are found, if a certain strategy 
cannot be maintained when confronted with another strategy.) 

(IV) The interactions (IV) describe imitative processes, in which an individual changes 
the strategy despite of the fact, that he or she convinces the interaction partner 
of his resp. her strategy. Social processes of this kind are very improbable and can 
normally be neglected. 



The different kinds of pair interactions have been discussed in |lb|, |18[ p3| . In the following, 
our considerations are restricted to imitative processes. The corresponding individual 
transition rates have, then, the following general form: 

w 2 (x',y'\x,y;n;t) = w* 2 {x\y; n; t)8 xx ,8 xyl {l - 8 xy ) 

+ wl(y\x;n;t)5 yyl 5y X i(l- 5 xy ) . (15) 

W2(y\x;n;t) is the rate of imitative strategy changes from x to y and shall be specified 
now: Let A xx > be the success of strategy x when confronted with strategy x' . Then, 

E(x;n;t) : =£^,I^ (16) 

x ' 

is the expected success of strategy x in interactions with other strategies. With 



exp 



E(y;n;t) - E(x;n;t) 



w*Mx; n; t) := , (17) 

imitative strategy changes from x to y will occur the more frequent, the greater the 
expected increase 

A yx E := E(y; n; t) — E(x; n; t) (18) 
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of success is, and the smaller the incompatibility ("distance") 

D(y,x;t) = D(x,y;t) > 



(19) 



between the strategies x and y is. ( |17D is a variant of the multinomial logit model [|16| |34 



which has shown to be suitable for the description of decision processes. The ansatz 
(|T7|) can also be derived by entropy maximization ||16| or with the FECHNERian law of 
psychophysics |16|, |35|. 



4 Selforganization of behavioral conventions by com- 
petition between strategies 

As an example for the behavioral equations, we shall consider a case where the individuals 
can choose between two equivalent strategies x G {1,2}, i.e., the payoff matrix A shall be 
symmetrical: 

A = (A xx >) : = 

For spontaneous strategy changes we shall assume the simplest form of transition rates: 

w l {x'\x\n\t) = W. (21) 

A situation of the above kind is the avoidance behavior of pedestrians [fH)| , [53]: In pedes- 
trian crowds with two opposite directions of movement, the pedestrians have sometimes 
to avoid each other in order to exclude a collision. For an avoidance maneuver to be suc- 
cessful, both pedestrians concerned have to pass the respective other pedestrian either on 
the right hand side (x = 1) or on the left hand side (x = 2). Otherwise, both pedestrians 
have to stop. Therefore, both strategies (to pass pedestrians on the right hand side or to 
pass them on the left hand side) are equivalent, but the success of a strategy grows with 
the number n x of individuals who use the same strategy. In the payoff matrix ( p0|) we 
have A > 0, then. 

Empirically one finds that the probability -P(l) for choosing the right hand side is usually 
different from the probability P(2) = 1 — P(l) for choosing the left hand side (see fig. |l]a). 
As a consequence, opposite directions of motion normally use separate lanes (see fig. [l|b). 

We will now examine, if the behavioral model can explain this break of symmetry. Figure 
H shows some computational results for D(y, x; t) = 2 and A = 1. If 

k:=1-AW<0, (22) 

the configurational distribution is unimodal and symmetrical with respect to n\ = N/2 = 
ri2, i.e., both strategies will be chosen by about one half of the individuals. At the critical 
point k = there appears a phase transition. This is indicated by the broadness of 
the probability distribution P(n,t) = P(ni,n2]t) = P(n\,N — ni;t), which is due to 
critical fluctuations. For k > the configurational distribution becomes bimodal in the 
course of time, so that one of the two equivalent strategies will very probably be chosen 
by a majority of individuals. This can be interpreted as selforganization of a behavioral 
convention. Behavioral conventions often obtain a law-like character after some time. 



A + B B 
B A + B 



(20) 



5 



(b) 



(a) 



P(2h 9 <P(1) 



P(l) 



<P(2) 



O 



ft 



o„o°o. 

o- °a 

4 



o o VI 



iO 



Figure 1: (a) For pedestrians with an opposite direction of motion it is advantageous, if both 
prefer either the right hand side or the left hand side when trying to pass each other. Otherwise, 
they would have to stop in order to avoid a collision. 

(b) Opposite directions of motion normally use separate lanes. Avoidance maneuvers are indi- 
cated by arrows. 

5 The most probable strategy distribution 

In order to understand the phase transition more explicitly, we shall in the following 
consider the equations for the most probable strategy distribution 

n x (t) 



P(x,t) :-- 



N 



with 



P(x, t)>0 and £ P{x, t) = 1 



(23) 



(24) 



where fi(t) denotes the most probable (socio) configuration. These equations are approxi- 
mately given by 



d 
dt 



P(x,t) = m x (n,t) 



(25) 



as can be seen by reformulating the master equation (f|) in terms of a Langevin equation 
3"3f . Here, 



m x {n, 



t) := ^2 \w(x\x'; n; t)P(x', t) — w(x'\x; n; t)P(x, t) 



are drift coefficients, and 



w(x'\x] n; t) := Wi(x'\x] n; t) + w 2 (x', y'\x, y; fi; t)n y 

y > y 



(26) 



(27) 



have the meaning of effective transition rates . It turns out that the explicit equations 
for the most probable strategy distribution P(x,t) are BoLTZMANN-like equations: 

d -P{x,t) = [wi{x\x';t)P{x',t) - w x {x'\x;t)P{x,t)\ (28a) 



dt 



+ E E E Mx, y'W, y\ t)p(x', t)p( y , t) 

x' y y' 

J2J2T,Mx',y'\x,y;t)P(x,t)p( y ,t) 

x' y y' 



(28b) 
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Figure 2: Probability distribution P(n,t) = P{n\,N — n\;t) of the (socio) configuration n for 
varying values of the control parameter k. For k = a phase transition occurs: Whilst for k < 
both strategies are used by about one half of the individuals, for k > very probably one of 
the strategies will be prefered after some time. That means, a behavioral convention develops 
by social selforganization. 
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with 



Wi(x'\x;t) := wi(x'\x; n; t) , (29) 
w 2 (x',y'\x,y;t) := Nw 2 (x' ,y'\x,y;n;t) . (30) 

Obviously, the terms ( [28b|) are Boltzmann (collision) terms resulting from pair interac- 
tions, whereas the terms ( j28a| ) are due to spontaneous transitions. 



5.1 Oscillatory and chaotic behavior 

For wi(x'\x] n; t) = 0, w 2 (x f , y'\x, y; n; t) = w 2 (x', y'\x, y), and 

W^, y\ x 'i v') = w 2 {x' 1 y'\ x ^ y) 



(31) 



equation (|28|) obeys the famous Boltzmann if-theorem [|l| 
dH 



dt 



<0 with H(t):=J2P(x,t)\nP(x,t). 



(32) 



According to the i7-theorem P(x,t) approaches a stationary solution Po(x) in the course 
of time. For example, in a dilute gase the velocity distribution approaches a Maxwell 
distribution. However, for social processes the relation ( |3"T| ) may be invalid (since there are 
no collisional invariants). As a consequence, the corresponding BoLTZMANN-like equations 
can show oscillatory or even chaotic solutions f[6|, ^] (see figures |3| and (|). 

For example, the special Boltzmann equations 



^P(x, t) = vP{x, t) [P(x - 1, t) - P{x + 1, t) 



with x = x mod 5* 



(33) 



display nonlinear oscillations (see fig. |^): A linear stability analysis around the stationary 
point Pq := (1/5*, ... , 1/S') tr shows that the eigenvalues of the corresponding jACOBIan 
matrix are purely imaginary EBl |T8l. Due to the relations 



(34) 



s s 

P(x, t) = 1 and P(x, t) = const. 

x=l x=l 



the trajectory P(t) = (P(l, t), . . . , P(S, t)) tr moves on a (S 1 — 2)-dimensional hypersurface. 
For 5* = 3 strategies the shape of the resulting cycles can be calculated explicitly. It is 
given by 



, s 1-P(l,t) 
P(2,t) = -^-^ ± 



\ 



1-P(l,t) 



C 



P(l,t) 



(35) 



with 



P(3, t) = 1 - P(l, t) - P(2, t) and C := P(l, t )P{2, t )P{3, t ) . (36) 
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t P(1,t) 

Figure 3: Oscillations are one possible effect of imitative processes. For S = 5 different strategies, 
the oscillatory changes look quite irregular without a short-term periodicity. The corresponding 
phase portrait has the shape of a torus, which indicates a long-term periodicity by the closeness 
of the curve. 



Boltzmann equations with chaotic solutions are, for example, given by the following 
interaction schemes: 

fei , 
fc 2 , 

fcs, 



4,9 
1,9 
1,9 
4,6 
1,1 
3,9 
2,3 
8,6 
6,7 
7,8 
4,4 
5,4 



fcs. 



fcfi 
fee 



1,9 
4,9 
2,9 
1,6 
3,3 
1,9 
1,3 
6,6 
7,7 
8,8 
4,5 
4,4 



where k\ denote the interaction rates W2{x' ,y'\x,y) of the pair interactions 

h 



x,y 



x', y' . 



Using the abbreviations 



a 
r(t) 
c 
d 
e 



= k[P(9,0)t, 
ak 5 /k[ , 
ak 6 /k[ , 
2ak i /k' l , 



a 
d 
e 
e' 



— k^/k'l, 

= h/k[, 

= ak' 5 /k[, 

= KIK > 

= k'J{k'ia) 
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b 

c" 

K 



= ak 6 /k' 6 , 

= k 2 /k[, 

= ak'*/k[, 

= ak 3 /k[, 



(37) 
(38) 



(39) 
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and the scaled variables y x {r) according to 



a 


if x G 


{1,2,4,6,7,8} 


P 


if x = 


3 


7 


if x = 


5 


1 


if x = 


9. 



(40) 



the corresponding BOLTZMANN equations are: 
d 



— j/i(r) = ay A (r)y 9 (r) - (b + l)yi(r)y 9 (r) + ny 4 (T)y 6 (T) 
dr 



d 



[yi{ r )f - y3(r)y 9 (r) + y 2 {r)y 3 {T 



d -yz( T ) = b yi( T )y9(r) - y 2 (T)y 3 (T) 



[yi(r)\ -y^{r)y 9 (r) 



2/4 (r) 



d 

dr 
dr 

dr 
d 

d:T 



2/9 (r) 



= -ay4(r)y 9 (r) + yi(r)y 9 (r) - m/4(t)j/ 6 

- dy A (T)[y±(r) - y 5 (r) 

= dy 4 (r) [|/ 4 (r) - j/5 (r) 

= 2/6 (r) [q/ 8 (r) - </y 7 (r) 

= 2/7 (r) [c'j/6(t) - c"j/ 8 (r) 

= 2/8 (r) [c'V(r) - q/ 6 (r) 

= 0. 



(41) 



For certain sets of parameters these equations have chaotic solutions. Especially, for the 
parameters 



a 


■= o, 


b 


:= 1.2, 


c 


:= 0.46, 


d 


:= 0.46, 


d 


:= 100, 


e 


:= 10000, 


e 


:= 0.01, 


e' 


:= 0.0001 



K 



and the initial conditions 



2/i(0) 
2/s(0) 

2/5(0) 
2/7(0) 



0.6, y 2 {0) 

0. 36 , j/ 4 (0) 

1, 2/e(0) 
1 + 0.12 sin (2tt/3) , y 8 (0) 



0.46, 
varying . 



1.8, 
1, 

1.12, 

1 + 0.12 sin (4?r/3) 



(42) 



(43) 



several period doubling sequences are found, if k € [0.15, 0.55] is varied (see [Hi] for a more 
detailled discussion). Figure (| shows computational results for k = 0.32. 
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Figure 4: Temporal development, phase portrait, power spectrum f(uo) and greatest Lyapunov 
exponents X x (k) of the scaled variables u x {t) = /J, x P(x,ut) for special Boltzmann equations 
that produces chaos. 
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6 The game dynamical equations 



The socalled game dynamical equations, which are used for the description of cooperation 
and competition processes, are also a special case of the BoLTZMANN-like equations. This 
is shown in the following: If we again restrict our considerations to imitative processes 
(see flT5|)), the special BoLTZMANN-like equations 



= ^2 \wi(x\x'; t)P(x', t) — Wi(x'\x; t)P(x, t) 

x' 

+ P(x, t) J2 [w2(x\x'; t) - w* 2 {x'\x] t) P(x', t) 



(44) 



result with 

W2(x'\x; t) := Nw^ix'lx; n; t) . (45) 

Inserting the multinomial logit ansatz ( |T?D and using a suitable Taylor approximation 
leads to the game dynamical equations 

d 



dt 



P(x,t) = [wi(x\x';t)P(x',t) - w l (x'\x]t)P{x,t) 



+ P(x,t) E(x,t) - (E) 



where 



E(x,t) :=E(x;fi;t) = Y, A 

x' 

is the expected success of strategy x, and 

(E) :=J2E(x',t)P(x',t) 



n x '(t) 
N 



(46a) 
(46b) 

(47) 
(48) 



is the mean expected success. Since ( |46b|) can be understood as effect of a selection (of 
strategies with an expected success that exceeds the average (E)) and ( |46a| ) can be in- 
terpreted as effect of spontaneous strategy changes (e.g. due to accidental mutations) the 
game dynamical equations are also known as selection mutation equations pi"| , [57]]. The 
mutation term can be used for the description of trial and error. 

As an example, we shall again examine the case of two equivalent strategies. The game 
dynamical equations fl4"6]) corresponding to (|20|), fl2l| ) have, then, the explicit form 



j f P(x, t) = -2 (p(x, t) - ~) [W + AP(x, t) (P(x, t) - 1 
According to ([49|), P(x) = 1/2 is a stationary solution. This solution is stable for 



K 



AW 

1 < 

A 



(49) 



(50) 



i.e., if spontaneous strategy changes are dominating and, therefore, prevent a selforgani- 
zation process. 
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At the critical point k = there appears a break of symmetry: For k > the stationary 
solution P(x) = 1/2 is unstable, and the game dynamical equations (^) can be rewritten 
in the form 

±P(x, t) = -2 ( P(x, t)-l)( P(x, t) - l±^) ( P(x, t) - . (51) 



dt v ' ' V v ' 2 

That means, for k > we have two additional stationary solutions P(x) = (1 + y/~K)/2 
and P(x) = (1 — y/R)/2, which are stable. Depending on initial fluctuations, one strategy 
will win a majority of 100 • ^/k percent. This majority is the greater, the smaller the rate 
W of spontaneous strategy changes is. 

The game dynamical equations (including generalizations and other derivations) are more 



explicitly discussed in [16, p 



7 Summary and Conclusions 

The master equation and BoLTZMANN-like equations have shown to be suitable for the 
quantitative description of behavioral changes and social processes. In the models devel- 
oped spontaneous strategy changes and behavioral changes due to pair interactions have 
been taken into account. Three kinds of pair interactions have been distinguished: imi- 
tative, avoidance and compromising processes. The game dynamical equations result for 
a special case of imitative processes. They can be interpreted as equations for the most 
probable behavioral distribution and allow the description of social selforganization of 
behavioral conventions. 
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